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A  project  was  initiated  in  the  fall  of  1983  to  quantitatively  assess  the 
accuracy  of  vegetation  cover  maps  produced  by  three  remote  sensing  techniques: 
machine  classified  Landsat  [MCL]  digital  multispectral  scanner  [MSS]  data, 
color  composite  Landsat  [CCL]  MSS  images  and  medium  scale  color  infrared 
[MSCLR]  aerial  photography.  Information  from  the  three  techniques  was 
compared  to  ground  truth  data  gathered  in  the  Piceance  Easin  Planning  Area  of 
northwest  Colorado. 

Assessments  were  made  using  a  site-specific  stratified  random  sampling 
design  and  analyses  based  on  error  matrices.  Several  ccrnparisons  were  made  to 
compensate  for  differences  among  the  vegetation  classification  systems  used 
with  each  remote  sensing  technique.  The  heterogeneous  mixture  in  the  upland 
shrub  surface  cover  type  was  difficult  to  map  accurately,  particularly  with 
Landsat  imagery.  Using  the  preferred  classification  system  (without  overlays 
of  cover  types)  machine  classified  Landsat  (MCL)  accuracy  was  26%,  CCL 
accuracy  was  27%  and  MSCIR  accuracy  was  58%.  Color  composite  Landsat  (CCL) 
had  the  lowest  total  mapping  costs  at  .062  cents/acre,  followed  by  MCL  at  4.14 
cents/acre  and  MSCIR  at  8.20  cents/acre.  Using  a  combination  of  MSCIR  for 
heterogeneous,  high  interest  areas  and  CCL  for  homogeneous ,  low  interest  areas 
may  provide  the  most  cost-effective  procedure  for  mapping  large  expanses  of 
rangelands. 
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INTRODUCTION 


As  world  energy  demands  become  greater  and  natural  resources  decrease, 
the  assessment  and  management  of  these  resources  becomes  increasingly 
important.  The  need  for  resource  information  that  meets  minimum  accuracy 
levels  will  rise  in  importance  as  the  need  for  better  management  of  natural 
resources  becomes  more  vital  (Aroncff,  1S82).  Mapping  of  natural 
resources,  particularly  those  concerning  wildlife  habitat,  by  remote 
sensing  methods  continues  to  be  refined.  However,  standard  methods  for 
estimating  cost  and  map  accuracies  of  various  remote  sensing  techniques 
used  for  specific  operational  applications  need  to  be  developed  before  one 
can  confidently  choose  between  mapping  alternatives.  Several  of  these 
issues  are  addressed  in  this  report. 

Vegetation  inventories  should  be  designed  to  obtain  the  desired 
information  at  the  lowest  cost.  There  is  an  increasing  need  and  trend  to 
incorporate  rangeland  inventories  into  a  Geographic  Information  System 
(GIS),  (Carneggie,  et.  ai.,  (1383).   The  incorporation  of  data  into  a 
digital  GIS  has  a  high  initial  cost.  However,  when  amortized  over  a  number 
of  years  the  cost  becomes  competitive  with  traditional  systems,  and  the 
ability  to  manipulate  and  analyze' map  based  information  is  greatly 
enhanced.  A  standard  test  methodology  is  needed  for  selecting  the  most 
efficient  and  effective  remote  sensing  technique  for  a  GIS  application 
( Arcnof f ,  1932 ) .  This  study  presents  an  approach  that  compares  remote  • 
sensing  techniques  with  the  objective  of  maximizing  mapping  accuracy  and 
utility  while  minimizing  mapping  cost  per  unit  area. 


Any  nap  accuracy  assessment  requires  a  kr.cwledge  of  errcr-prcducirJ^ 
factors,  as  well  as  mapping  rcethcds,  procedures,  applications  and 
technological  limitations.  An  assessment  of  surface  cover  map  accuracy 
should  include  a  statement  about  the  type  of  accuracy  assessment, 
identification  of  the  relevant  error  causing  variables,  an  examination  of 
the  types  of  site  specific  napping  errors,  and  a  description  of  the 
physical  representation  of  the  Minimum  Mapping  Unit  (MMU) . 

She  relevant  error  causing  variables  in  a  surface  cover  mapping 
project  include  the  number  of  surface  cover  classes  to  be  identified,  the 
scale  or  resolving  power  of  the  input  data  and  output  map,  and  the  size  of 
the  MMU.  Generally,  as  the  number  of  surface  cover  classes  utilized 
increases,  as  the  map  scale  decreases  and  as  the  minimum  mapping  unit 
increases,  overall  map  accuracy  decreases.  The  minimum  level  of  resolution 
in  Landsat  MSS  ray  be  as  small  as  a  single  pixel  (50m  x  50m) .  In  1:24, C^fc 
aerial  photography  (MSCIR) ,  the  resolution  is  less  than  3m  x  3m.  However, 
it  is  impractical  to  map  at  the  minimum  level  of  resolution,  partly  because 
resolution  implies  detection  but  not  necessarily  recognition.  Therefore, 
in  mapping,  the  MMU  is  generally  much  larger  than  the  minimum  level  of 
resolution.  This  implies  that  large  MMUs  may  contain  a  number  of 
unrecognized  cover  types  in  a  heterogeneous  mixture  with  the  recognized 
dominant  cover  type. 

At  aerial  photo  scales  of  1:125,000  to  1:250,000,  the  MMU  is  160  to 
640  acres  (Cameggie,  et.  ai.,  1983).  For  aerial  photo  scales  of  1:31,680 
to  1:63,360,  the  MMU  is  10  to  40  acres.  Highly  valued  vegetation  classes 
such  as  wetlands  may  be  delineated  by  a  smaller  MMU  than  low  value  classes. 
For  Landsat  MSS  digital  data  use  in  rangeland  mapping,  cover  types  need  tf 
be  20  to  40  acres  in  si-  to  be  derected  and  recognized.  Manual 


* 


classification  of  Landsat  MSS  imagery  for  rangeland  mapping  generally  uses 
a  IM3  of  160  to  640  acres. 

There  are  at  least  three  types  of  site  specific  mapping  errors.  1) 
Control  point  location  (map  registration)  error  is  a  measure  of  the 
inaccuracy  of  the  position  of  a  known  point  on  the  ground  as  it  is 
represented  on  the  map  (Hord  and  Brooner,  1976).  National  map  accuracy 
standards  measure  control  point  location  error  only.  Because  of  the 
homogeneous  and  relatively  undeveloped  nature  of  the  study  area,  sufficient 
points  could  not  be  identified  for  evaluating  control  point  location  error. 
2)  Classification  error  measures  the  agreement  of  a  point  on  a  map  with  the 
true  class  (e.g.,  vegetation  type)  observed  on  the  ground  (ground 

n 

truth/ref erence ) .   Classification  error  assessment  requires  a  relatively  || 

§ 
unambiguous  classification  as  a  basis  for  comcarison.  Error  matrices,  also 

1 

called  conrusion  tables,  can  be  used  to  assess  the  effects  of  f| 

classification  error  on  the  final  product.  3)  Boundary  line  error  involves 
a  boundary  line  on  the  map  that  dees  not  necessarily  conform  to  the  true 

H 

position.     Because  boundaries  are  largely  an  abstraction  of  the  || 

1 
cartographer  or  cartographic  process  and  the  definition  of  mapping  units  is  % 

■ 

frequently  ambiguous,  ground  location  of  a  gradational  boundary  usually  M 

cannot  be  verified.  Boundary  line  error  is  net  readily  measured,  but 
boundary  location  can  be  estimated  by  utilizing  vegetation  cover 
measurements  from  line  transects  perpendicular  to  the  boundary  line. 

The  minimum  mapping  unit  may  be  depicted  as  a  cell  (raster)  or  a 
polygon.  A  number  of  cell  based  MMU's  are  in  use,  with  the  MSS  pixel  being  ji 

one  of  the  mere  common.  Vegetation  types  are  frequently  depicted  as  9 

1  w 

polvgcns,  consisting  of  numerous  cells,  that  are  constructed  to  represent  Jt 

S 

the  daninant  recognizable  vegetation.     Due  to  the  mixture  of  vegetation  ffi 

X 


;y::?. 


types  frequently  present  in  a  MKJ  polygon  and  the  subjectively  recogniz 
edges  used  for  polygon  delineation,  overall  polygon  accuracy  nay  not  be  « 
great  as  it  appears. 

In  the  fall  of  1983  this  project  was  initiated  to  conduct  a 
quantitative  accuracy  assessment  of  a  vegetation  data  base  used  in  a 
simulation  model  designed  by  the  Northwest  Colorado  Wildlife  Consortium  to 
predict  the  cumulative  impact  of  energy  development  upon  deer  and  eU<  in 
northwestern  Colorado.  The  principal  objectives  of  this  project  were  to 
evaluate  the  accuracy  of  three  different  methods  used  to  produce  vegetation 
data  bases  and  to  identify  which  of  the  methods  met  minimum,  accuracy  needs 
and  cost  requirements  for  the  deer  and  eUc  model.  The  methods  examined 
were  1)  A  Machine  Classified  Landsat  (MCL)  MSS  system  using  digital  data, 

2)  manually  classified  false  Color  Composite  landsat  (CCL)  MSS  images,  an* 

3 )  manually  classified  Medium  Scale  Color  Infrared  aerial  photography 
(MSCER) . 
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DESCRIPTION  CF  THE  STUDY  AREA 

This  study  was  restricted  to  the  Bureau  of  Land  Management's  (ELM) 

I 

Piceance  Basin  Planning  Area,  which  has  been  extensively  mapped  by  various 

1 

I        agencies  in  the  last  few  years  (USDI,  ELM,  1984).  The  boundaries 

I 

I        established  for  Spatial  Unit  1  of  the  Northwest  Colorado  Wildlife 

Consortium  deer-elk  model  lie  within  this  planning  unit  and  correspond  to 

Management  Unit  22  of  the  Colorado  Division  of  Wildlife.  Spatial  Unit  1 

includes  approximately  85%  of  the  Piceance  Basin  Planning  Unit,  excluding 

areas  west  of  Range  100  West  or  in  the  Parachute  Creek  and  Rcan  Creek 

drainages'. 


Physical  Description:  The  Piceance  Basin  Planning  Area,  located 
principally  in  Rio  Blanco  County  in  northwest  Colorado,  comprises 
approximately  804,500  acres  of  land  as  delineated  in  the  BLM's  Resource 
Management  Plan  (USDI,  ELM,  1984).  It  is  bounded  by  the  White  River  on  the 
north,  the  Cathedral  Bluffs  on  the  west,  the  Rcan  Cliffs  on  the  south  and 
Highway  13  and  789  on  the  east  (Figure  1).  Approximately  23%  of  this  land 
is  privately  owned;  the  remainder  (615,489  acres)  is  federally  owned  and 
managed  by  the  ELM.  The  climate  of  the  basin  is  semiarid  continental,  with 
hot  surrmers  and  cold  winters.  The  Piceance  Basin  shows  a  gradual  rise  in 
elevation  from  approximately  5,500  feet  at  the  White  River  in  the  northwest 
to  8,500  feet  on  the  Roan  Plateau  to  the  south.  The  basin  is  an  extension 
of  the  Dintah  Basin  of  Utah,  and  is  principally  Cretaceous  in  its  age  of 
formation.  The  Green  River  Formation,  which  has  seme  members  rich  in  oil 
shale,  is  an  iiriporcant  geologic  constituent  of  this  basin  (USDI,  ELM, 
1984). 


U'-. 


'-©" 


-  c 


*      1-  I  I     .    II  !* 

&'      L  - 


i  ■    — r-.ec 

:  i  77 


P  ;  I  ]*--».  i 


,  :{. 


.-»      r 
'i 


*  ■• 


6 

i  • 


v   •;  -'J    !> 


CO 

< 

CO 

o 

< 

LU 

o 


< 

UJ 

s 

cc 

CO 

4 

< 

0 

1 

CD 

£? 

c 

2 

& 

S- 

TJ 

JS 

C     O   r—             Ol 

u_ 

«3 

u 

f-   D>  3         "O    GJ 

22 

3 

c 

ra  -o  o  x:  ■>-  cr 

C 

It) 

+j  »r-        u  cs;  -a 

2 

0£ 

C  (K  -t->  i—         1- 

to 

3        or^a: 

< 

«J 

CO 

O   >,a  C9   O 

to 

£  +J               *   <x> 

=3 

01 

i-   <D  «4-  JS    £ 

S_ 

i.     g   r—  <4-     S_     « 

Q. 

<T3 

re  «  u  o  o  2: 

3 

CT5i —    i-  +J    M 

O" 

11    «Jt-    D    «    O 

to 

to  o  o  cj  a;  s: 

f-  Cvl  OO   C  W  IB   IN 


4- 


Vegetation  Description;  Moisture  and  substrate  are  the  major  physical 
parameters  that  influence  the  f loristic  composition  and  community  structure 
of  the  vegetation  in  the  Basin.  Species  ccmposition  is  closely  related  to 
moisture,  exposure,  substrate  and,  to  a  limited  extent,  grazing.  Variation 
in  community  types  results  largely  from  differences  in  relief,  exposure  and 
elevation  (Cook,  1974). 

The  vegetation  of  the  Piceance  Basin  can,  in  a  general  way,  be  divided 
into  seven  major  community  types  based  on  aspect,  as  influenced  by  the 
dominant  vegetation  (USDI,  BLM,  1984).  These  are:  1)  Kalophytic  shrub, 
including  lowland  sagebrush,  saltbush  and  greasewccd;  2)  Sagebrush,  in 
various  associations;   3)  Pinycn  pine  and  Utah  juniper  woodland,  in  various 
associations;  4)  Upland  shrub,  including  serviceberry,  sagebrush, 
rabbitbrush,  snowberry,  oakbrush,  mountain  mahogany,  and  chokecherry;  5) 
Aspen;  6)  Douglas  fir;  7)  Grassland  (Appendix  I).  Acreages  and  percent 
occurrence  are  from  the  Bureau  of  Land  Management's  Resource  Management 
Plan  (USDI,  BLM,  1984),  and  are  given  for  public  lands. 

Halophytic  shrub;  The  halophytes  are  severely  limited  by  elevation, 
occurring  below  6600  feet  and  covering  2%  or  14,403  acres  of  the  Basin. 
They  are  found  in  bottomlands  and  broad,  flat  valleys  where  salinity  in  the 
surface  soils  is  high.  Rabbitbrush  and  sagebrush  often  occur  with 
halophytes  but  disappear  with  increasing  salinity.  Greasewccd  and  saltbush 
(shadscale)  are  the  dominant  species. 

Sagebrush:  Sagebrush  is  the  major  community  type  of  the  Easin  and 
occupies  42%  or  256,833  acres  of  the  area.  It  occurs  across  an  elevational 
range  of  6,000  to  8,300  feet  and  is  found  on  relatively  deep,  fertile, 
well  drained  soils.  It  thrives  on  both  westerly  and  easterly  slopes  while 
generally  reaching  its  fullest  expression  on  bottomlands  and  west-facing 
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slopes-  It  is  often  found  in  association  with  rabbitbrush  and  a  varidffl  Hf 
grasses.  Sagebrush  is  not  recognized  as  a  separate  caranunity  in  the 
Northwest  Colorado  Wildlife  Consortium  deer-elk  model. 

Pinyon-Juniper  woodland:  Pixiyon  pine  and  Utah  juniper  dominate  this 
community  type  which  is  found  on  ridgetops  and  sideslopes  below  7,800  feet 
and  which  occupies  172,146  acres,  or  28%,  of  the  Easin.  These  woodlands 
occur  on  soils  which  are  much  shallower  than  those  that  support  sagebrush 
ccmnunities.  Pinyon- juniper,  occurring  on  all  slopes  as  well  as  on  the 
bottomlands,  is  often  found  in  association  with  serviceberry,  mountain 
mahogany,  sagebrush,  bitterbrush,  and  several  grasses.  The  optimum 
development  of  this  cccinunity  is  found  on  north-facing  slopes  at  elevations 
from  7,000  to  7,500  feet.  Moisture  is  less  than  that  received  by  upland 

- 

shrub  ccmnunities. 

Upland  shrub:  This  vegetation  type  is  frequently  dominant  at 
elevations  above  7,2C0  feet  but  does  range  from  6,500  feet  to  8,700  feet  on 
well  developed  soils.   It  occupies  107,210  acres,  or  17%,  of  the  Easin  and 
is  most  prevalent  on  north-facing  slopes  and  ridgetops.   West-facing 
slopes  are  favored  over  east-facing  slopes.  Major  shrub  species  in  this 
vegetation  type  include  serviceberry,  sncwberry,  Gsmbel's  oak,  sagebrush, 
and  mountain  mahogany.  Babbitbrush,  chokecherry  and  juniper  are  found  in 
lesser  amounts.  This  vegetation  type  tends  to  occur  in  a  mosaic  with  most 
vegetation  types  found  in  the  Piceance  Creek  Basin. 

Aspen:  Aspen  covers  10,755  acres,  or  2%  of  the  Easin,  arid  is 
restricted  to  elevations  above  7,000  feet,  with  most  stands  occurring  above 
8,000  feet.  This  brcadleaf  tree  may  occur  in  pure  stands,  as  a  dominant 
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overstory  and  in  mixed  comrunities .  At  upper  elevations  it  occurs  on  well 
developed  soils  and  forms  dense  forest.  It  ircre  commonly  occurs  in 
drainage  bottoms  and  along  perennial  streams  at  lower  elevations.  Aspen  is 
found  in  association  with  serviceberry,  Gambel's  oak,  chokecherry  and 
sncwberry  in  various  combinations,  and  occurs  on  ridge  tops  and  all  slopes 

m 

at  the  higher  elevations.  Gn  drier  sites  at  lower  elevations,  aspen  is  ;*£ 

m 

restricted  to  snow  accumulation  areas.  The  understory  may  include  several 

im 

soecies  of  fern  and  a  variety  of  herbaceous  taxa.  ff§ 

ff§i 
Douglas  fir:  These  communities  occur  on  9,221  acres,  1.5%  of  the  m 

Basin,  and  are  restricted  to  the  north  and  northwest  s lores  between  7,500  i|J 

and  9,000  feet.  They  occur  most  frequently  on  slopes  greater  than  25%.  M 

Iff 

tost  stands  consist  of  mature  to  overmature  trees.  Douglas  fir  forms  |§ 

W 
p| 

closed  canopies  over  a  shrub" layer  dominated  by  serviceberry,  chokecherry,  0 

sncwberry  and  wild  rose.  The  herbaceous  layer  is  poorly  developed.  |g 

Grassland:  Grasslands  occupy  18,168  acres,  or  3%  of  the  Basin. 
Although  found  at  all  elevations,  grassland  is  most  prevalent  below  7,000 
feet.  Some  of  these  lower  elevation  areas  consist  of  hay  meadows.  Major 
species  include  western  wheatgrass,  Letterman  needlegrass,  Idaho  fescue  and 
a  variety  of  biuegrasses.  Rabbi thrush  is  often  associated  with  grassland. 

Public  lands  not  included  in  the  above  vegetation  descriptions ■ occupy 
4%,  or  26,753  acres.  Roads,  borrow  pits,  building  compounds,  barren  lands, 
cliffs,  rock  outcrops,  etc.  are  included  here. 

With  the  exception  of  the  halcphytic  shrub  and  Douglas  fir 
comrunities ,  all  major  vegetation  types  in  the  Ficeance  Basin  may 
intergrade  with  each  other.  Elevation,  aspect,  soil  type,  geologic  parent 
material  and  slope  position  are  responsible  for  gradients'  expressed  in  the 
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vegetation.     For  example,  the  percentage  coi^ositicn  of  low  elevation 
pinyon-juniper  amities  is  conspicuously  different  from  high  elevatSf 
coanunities,  the  latter  having  much  n»re  juniper.     A  more  detailed 
vegetation  classification  can  be  found  in    Lindauer,  et  al.    (1982).     A  list 
of  plant  species  identified  in  this  project  rray  be  found  in  Appendix  I. 
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METHODS 

Public  land  Survey  section  corners  within  seven  U.  S.  Geological 
Survey  7  1/2  minute  quadrangles  in  the  Piceance  Easin  Planning  Area  were 
ground  truthed  in  an  effort  to  evaluate  three  remote  sensing  data  bases. 
The  map  sources  and  methods  used  in  this  study  are  described  as  follows: 

Source  of  Vegetation  Maps:  Three  vegetation  mapping  techniques  are 
evaluated  in  this  project.  The  only  digital  data-base  (with  vegetation 
types  quantified)  available  to  the  Consortium  for  constructing  its  model 
was  prepared  by  the  U.S.  Fish  and  Wildlife  Service  (FWS).  That  agency 
conducted  a  mapping  project  in  northwest  Colorado,  including  the  Piceance 
Easin,  as  part  of  an  effort  to  determine  the  impact  of  coal,  shale  oil,  and 
tarsands  development  en.  wildlife  habitat.  The  manually  classified 
1:250,000  Color  Composite  Landsat  (CCL)  imagery  purchased  fran  the  EROS 
Data  Center,  U.S.  Geological  Survey,  provided  the  data-base  for  the 
Consortium's  model.  In  addition,  the  BLM  Colorado  State  Office  and  the  FWS 
conducted  an  intensive  medium  scale  (1:24,000)  color  infrared  (MSCTR) 
mapping  project  of  Northwest  Colorado  that  provided  a  surface  cover/land 
use  data-base  for  the  Piceance  Basin  Resource  Management  Plan  (USDI,  ELM, 
1984).  The  Resource  Management  Plan  utilized  the  MSCTR  data-base  in  the 
MOSS  (Map  Overlay  and  Statistical  System)  GXS.  A  Machine  Classified 
landsat  mapping  project  was  conducted  by  the  ELM  Denver  Service  Center  for 
land  use  planning  in  the  White  River  Resource  Area,  including  the  Piceance 
Easin  Planning  Area.  Procedures  fcr  cemputer-asssisted  image 
interpretation  (MCL)  and  manual  image  interpretation  (CCL  and  MSGER)  have 
been  described  by  Estes,  et.  al.  (1983). 


19 


The  MCL  mapping  task  utilized  Landsat  scene  8223471750X0,  acquid 
July  20,  1980  (D.  Osborne,  unpublished  report,  1933).  The  project  area" 
portion  of  the  scene  was  entered  into  the  BLM's  HP-30GQ  using  ESL  UDIMS 
software.  The  project  area  was  registered  to  a  50m  grid  in  a  Universal 
Transverse  Mercator  Projection  using  ground  control  point  for  each  of  the 
34  7.5  minute  quadrangles.  An  unsupervised  classification,  using  a  maximum 
likelihood  decision  rule,  was  performed  on  the  image.  The  resulting 
classified  image  was  stratified  into  four  elevation  breaks  (5000  to  5300 
ft.,  5301  to  6000  ft.,  6001  to  7000  ft.,  above  7000  ft.)  based  en 
associated  vegetation  differences.  Forty-two  spectral  classes  were  grouped 
into  32  resource  categories  for  the  area. 

Intrepretation  of  Landsat  color  composite  imagery  and  MSCIR  has  been 
extensively  described  by  others  including  Carneggie  et  al.,  1983. 

Sample  Selection:   The  site-specific  map  accuracy  assessment 
approach,  in  which  two  registered  data  sets  (one  of  them  ground  truth)  axe 
compared  for  amount  of  agreement,  was  selected  over  the  non-site  specific 
assessment  in  which  total  acreages  are  compared  without  regard  ro  location. 
The  site-specific  assessment  was  selected  since  it  is  considered  ircre 
rigorous  and  informative  (Mead  and  Szajgin,  1982).  To  quantitatively 
assess  the  accuracy  of  the  vegetation  data  from  the  MCL,  CCL  and  MSCIR 
mapping  methods,  it  was  necessary  to  determine  on-site  vegetation  types  at 
a  minimum  of  50  sample  stations  (Hay,  1979). 

A  stratified,  systematic,  unaligned  sampling  design  was  used  so  that 
unbiased  estimates  of  the  probability  of  occurrence  of  each  vegetation 
class  would  be  provided  and  the  classification  system  could  be  evaluated 
and  improved  (Dozier  and  Strahler,  1983).  The  sampling  design  contains 
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two  strata  (lew  elevation  quadrangles,  high  elevation  quadrangles),  three 
replicates  (7.5  minute  quadrangles)  per  strata,  ten  clusters  (Public  Land 
Survey  section  corners  marked  with  "brass  caps")  per  replicate,  and  nine 
sampling  units  (pixels)  per  cluster.  To  select  the  sample  sites,  the  23 
mapped  quadrangles  were  stratified  by  elevation  and  identified  as  high 
elevation  (above  7,000  feet)  or  low  elevation  (below  7,000  feet).  This 
categorization  was  accomplished  by  finding  the  minimum  and  maximum 
elevations  of  each  of  the  quadrangles  and  then  using  the  mid-range  ' 
elevation  for  assignment.  This  resulted  in  11  quadrangles  being  assigned 
to  the  high  elevation  type  and  10  to  the  low  elevation  type.  Two 
quadrangles  could  not  be  clearly  separated  by  elevation  (midrange  elevation 
was  within  100  feet  of  the  7000  foot  contour)  and  were  not  included  in  the 
assessment. 

Three  quadrangles  were  randomly  selected  from  each  of  the  assigned 
elevation  areas  and  ten  Public  Land  Survey  section  corners  were  chosen 
randomly  from  each  quadrangle  for  a  total  of  60  sample  sites.  However,  the 
absence  of  a  complete  Public  Land  Survey  in  one  high  elevation  quadrangle 
and  the  inability  to  gain  legal  access  to  several  section  comers  in 
another  high  elevation  quadrangle  necessitated  the  selection  of  an  adjacent 
quadrangle  and  a  reduction  in  the  sample  size  to  52  sites.  Each  of  the  52 
sampling  sites  contained  nine  pixels,  giving  a  total  of  468  pixel  samples. 
In  addition,  the  nine  pixels  comprising  each  group  were  aggregated  into  a 
single  vegetation  class  for  comparison  at  the  site  level.   Locations  of' 
sample  sites  are  given  in  Appendix  II. 
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Field  Methods:  Two  project  crews  were  organized  tc  conduct  tbe\ 
ground  truthing  in  September  of  1983.  Two  crews  of  Colorado  Division  of 
Wildlife  (DOT)  employees  located,  marked  and  flagged  access  to  section 
corners.  The  surveyed  section  corner  carters  ("brass  caps")  provided  the 
only  positively  identifiable,  uniformly  distributed  locations  present  both 
on  the  ground  and  on  U.  S.  Geological  Survey  topographic  maps. 

Two  types  of  information  were  gathered  at  each  sampling  site  (section 
corner).  First  the  percent  canopy  cover  of  woody  vegetation  was  determined 
using  a  150  meter  line  transect.  This  line  ran  north  and  south  and  was 
centered  over  the  brass  cap.  Second,  the  area  surrounding  the  brass  cap 
was  divided  into  9  pixels  in  order  to  designate  vegetation  types.  This 
gave  a  3  pixel  by  3  pixel  (150m  by  15 Cm)  area  centered  on  the  brass  cap. 
Project  crews  visually  assigned  each  pixel  to  a  vegetation  type. 

Vegetation  Classification:  As  is  often  the  case,  different  vegei 
classification  categories  were  used  in  the  various  mapping  projects.  All 
three  mapping  projects  generally  followed  the  surface  cover  classification 
scheme  used  by  the  U.  S.  Geological  Survey  (Anderson,  et.  al.,  1976)  which 
includes  several  levels  of  detail  (Appendix  III  and  IV) .   Level  1  divides 
the  earth  into  nine  categories,  and  Level  2  further  divides  these  general 
categories  into  more  specific  hierarchical  units.  The  MSCER  project  mapped 
the  Piceance  Basin,  for  the  most  part,  at  levels  3  -Jid  4  using  a  species 
association  subunit  (Appendix  III ) .  The  canopy  cover  of  the  dominant 
vegetation  and  the  understory  were  both  quantified  (S.  Williamson, 
unpublished  report,  1983). 
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An  initial  comparison  of  total  acreages  in  the  six  original 
quadrangles,  as  obtained  from  MCL  and  iMSCIR  data,  suggested  a  considerable 
variation  in  the  acreages  of  the  vegetation  types  between  the  two  mapping 
projects  (Table  1).  Since  the  classification  systems  were  not  parallel,  it 
was  necessary  to  assign  all  of  the  systems  to  a  combined  classification 
system.  For  the  first  set  of  comparisons,  the  classification  systems  were 
condensed  into  13  categories  (Table  2).  In  this  comparison  sane  categories 
were  absent  in  one  or  more  of  the  remote  sensing  systems  used.  For 
example,  the  MCL  classification  system  did  not  distinguish  two  of  the 
pinyon- juniper  associations  (PJ/SG  and  PJ/US).  To  circumvent  this  problem, 
a  second  comparison  was  made  by  reducing  the  13  categories  to  7  categories, 
forming  a  "collapsed"  classification  system  (Table  3).  This  provided  a 
one-to-one  correspondence  in"  all  systems.  A  third  "general"  classification 
was  made  by  comparing  these  dominant  species  or  species  mixtures  of  the 
three  mapping  projects  to  the  13  categories  of  the  combined  classification 
system  (Table  4).  A  match  was  identified  when  either  the  dominant  species 
or  a  dominant  association  fell  within  one  of  the  13  caregories. 

Data  Analysis:  Data  were  analyzed  at  both  a  pixel  and  a  site  level. 
At  the  pixel  level,  a  one-to-one  manual  comparison  was  made  between  the 
ground  truth  vegetation  assignments  for  a  pixel  and  those  obtained  from 
MCL,  CCL  and  MSCTS.  Vegetation  assignment  at  the  site  level  was  determined 
by  identifying  the  most  frequently  occurring  vegetation  type  within  the 
nine  pixels.  This  was  done  for  ground  truth  and  remotely  sensed  data. 

The  data  obtained  from  the  above  comparisons  were  analyzed  using  an 
error  matrix  approach  that  identifies  the  number  of  correctly  identified 
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Table  1  Comparison  of  Total  Acreages  in  the  Six  Original  Quadrangles  as  Obtained  from  Machine 
Classified  Landsat  (MCL)  and  Medium  Scale  Color  Infrared  Photography  (MSCIR)  Data 


Quad- 
rangle 

Square  S  Ranch 

No   Name  Ridge 

Razorhack 
Ridge 

Segar  Mountain 

Circle  Dot 
Gulch 

Calamity  Ridge 

Remote 

Sensing 

Method 

MCL 

MSCIR 

MCL 

MSCIR 

MCL 

MSCIR 

MCL 

MSCIR 

MCL 

MSCIR 

MCL 

MSCIR 

MCL 

MSCIR 

Vegetation 
Type 



._ 

„ 

Total   Acres 

Aspen 

1 

- 

4,662 

- 

9,139 

6,059 

0,025 

156 

10,816 

553 

2,947 

35,610 

6,768 

Grassland 

5,145 

1,640 

648 

ftl7 

11 

2,538 

427 

307 

762 

89 

1,143 

746 

8,436 

6,137 

Ifd  1  opliy  tes  1 

606 

3,117 

701 

9oa 

214 

167 

2,0)3 

572 

1,010 

1,125 

1,912 

2,617 

6,536 

8,316 

Douglas   fir 

6 

16 

907 

3,206 

1,214 

3,216 

653 

1,553 

592 

1,478 

497 

478 

3,869 

10,027 

Sagebrush 

17,061 

9,177 

6,520 

19,850 

2,556 

14,713 

3,923 

15,153 

1,892 

22,491 

6,929 

6J66 

38,881 

87,558 

Pinyon/ 

Juniper? 

12,331 

19,035 

14,739 

5,160 

8,979 

1,804 

14,105 

0,706 

7,259 

298 

16,464 

15,167 

73,957 

50,178 

Upland 
Shrub-' 

11 

*" 

7,650 

5,620 

13,844 

7,726 

7,312 

9,521 

12,718 

4,280 

7,507 

10,741 

49,045 

37,888 

lotal 

35,464 

32,985 

35,927 

35,737 

35,957 

36,223 

36,538 

35,960 

35,049 

30,314 

37,399 

35,915 

•$ago  bottomlands  (MCL)  included  in  MCL  halophyte  acres 

Greasewood  (MSCIR)  and  SalLhusli  (MSCIR)  included  in  MSCIR  halophyte  acres 


Zpinyon  (MCL)  included  in  MCL  pinyon/juniper  acres 
Huntain  shrub  (MCL),  oakbrush  (MSCIR)  and  serviceben 


rush  (MCL)  included  In  upland  shrub  acres 
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Table  2  Relationship  of  a  Combined  Classification  System  to  three  other  Classification 

Systems  used  in  Piceance  Basin  Ground  Truth  Remote  Sensing  Vegetation  Data  Base 


1 
? 

■IS- 

1 
■■>> 

:!. 

•■: 

i 

Combined  Classification 
System 

Sround  Truth 
Classification 
System 
(APPENDIX  I) 

Machine 

Classified 

Landsat 

System 
(APPENDIX   III) 

Color  Composite 
Landsat  and  Medium 
Scale  ColGr   Infrared 
Classification   System 
(APPENDIX    IV) 

I 

1. 

AS 

Aspen 

AS 

4                 AS 

AS 

* 

2. 

AS/ US 

Aspen/Upland 
Shrub 

AS/S3,   AS/SN,   AS/SG, 
AS/S3/CC,   AS/SN/S3 

5                  AS/ US 

AS/ US 

3_ 

Df 

Douglas  Fir 

OF,   DF/SG,   DF/MD,    DF/PJ 

1                  DF 

DF 

'i 

4. 

GR 

Grassland 

GR,  MO,  GR/SG 

26,23"       GR 

3N/SH,   B.VBS, 

211,   212 

-  ■ 

HA 

Halophytic 
Shrub 

GW ,   G"«J/SG 

(3,9,          HA 
10,11,12 
poten- 
tial! y)' 

HA/SG,    GR/SG 

4 

I8 

PJ 

Pinyon/ Juniper 

PN,   PJ,   JN,   PJ/DF 

(13,19,   -PJ 

20,21,22 

23,24)* 

PJ,   ?v,   JN, 
PJ/HR 

7. 

PJ/SG 

PJ/Sage 

PJ/SG,   PJ/SG/GW 

None 

PJ/SG 

3. 

PJ/US 

PJ/Upland  Shrub 

PJ/MS,   PN/S3,   PJ/OB    .. 

None 

PJ/US 

9. 

SG 

Sage 

SG,   SG/GW 

(13,14,     SG 

15,15, 

17)* 

SGHR,    5G 

10.   WE     Wetlands 


MD/S7 


1. 

US 

Upland  Shrub 

08,   S3/CC,    SB,  MM,  MS 
SG/RS,   SG/S3,   SG/SN 
S3/SG,   S3/PN   - 

6,7 

2. 

SO 

Shale  Outcrop 

tone 

32 

3_ 

RO 

Roads 

None 

None 

National  Wetland* 
Inventory  CI  asses 

US,  OS/ US,  08, 
OB/SG,  SG/US 


Mcr.e 
None 


♦See  the  indicated  Appendices  for  detailed  classification. 
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Table  3:  Collapsed  Classification  System  (13  categories  of  the  Combined 
Classification  System  were  condensed  to  7  categories ) . 


Collapsed  Classification  System      Combined  Classification  System 


1, 

AS 

Aspen 

2. 

GR 

Grass 

3. 

HA 

Halophytics 

4. 

PJ 

Prnyon/Juniper 

5. 

SG 

Sage 

6. 

US 

Upland  Shrub 

7. 

OT 

Other* 

1,2 

AS,  ASATS 

4 

GR 

5 

HA 

6,7,8 

PJ,  PJ/SG,  PJ/US 

9 

SG 

11 

US 

3,10,12,13 

DP,  WE,  SO,  RD 

*  Those  classes  with  less  than  10  occurrences  were  classified  into  a 
new  "other"  grouping. 
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Table  4:  General  Classification  System  (This  table  illustrates  the  vegetation 
types  -  dominant  and  mixed  vegetation  -  that  was  identified  as  a 
match  with  the  13  categories  from  Combined  Classification 
categories ) . 


13  Categories  From  Combined 
Classification 


Matches  for  General  Classification 


1. 

AS 

1,2 

AS,  AS/US 

2. 

AS/US 

1,2,11 

AS,  ASATS,  US 

4. 

DF 

3 

DF 

4. 

GR 

4 

GR 

b. 

HA 

5,9 

HA,  SG 

6. 

PJ 

6,7,8 

PJ,  PJ/SG,  PJ/US 

/. 

PJ/SG 

6,7,8,9 

PJ,  PJ/SG,  PJ/US,  SG 

3. 

PJ/US 

6,7,8,11 

PJ,  PJ/SG,  PJ/US,  US 

9. 

SG 

5,7,9 

HA,  PJ/SG,  SG 

li? 

WE 

10 

WE 

Jll. 

US 

2,8,11 

AS/US,  PJ/US,  US 

iZ. 

SO 

12 

SO 

13. 

RD 

13 

RD 

AS 

Aspen 

JN 

Juniper 

SO   Shale  Outcrop 

DF 

Douglas  Fir 

PJ 

Pinyon/Juniper  Assoc. 

US   Upland  Shrub 

GR 

Greasewood 

RD 

Road 

We   Wetland 

HA 

Halophytic  Shrub 

SG 

Sagebrush 

i 

I 
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points  (concurrence  between  ground  truth  and  remotely  sensed  data)  as 
as  errors  due  to  omission  or  commission.  An  omission  error  occurs  when? 
sampling  unit  representing  a  particular  classification  type  is 
misclassified,  thus  under-representing  that  classification  type.  A 
caimissicn  error  occurs  when  that  misclassified  sampling  unit  is  added  to 
the  list  for  another  classification  type,  thus  over-representing  that 
classification  type.  Overall  error  is  the  proportion  of  the  total  number 
of  sampling  units  that  were  incorrectly  identified  in  comparison  to  the 
actual  field  determinations,  regardless  of  classification  type.  The  small 
number  of  occurances  observed  for  individual  classes  in  the  classification 
precludes  an  analysis  (e.g.,  calculation  of  confidence  intervals)  of 
individual  class  classification  accuracy. 

Cost  comparisons  for  MCL,  CCL  and  MSCIR  were  made  in  an  effort  to  ^^ 
assist  land  managers  in  selecting  the  most  economical  mapping  method  JHW 
available  resources.  A  final  comparison  was  made  by  separating  the 
remotely  sensed  data  from  quadrangles  with  midrange  elevations  above  and 
below  7,000  feet.  This  was  done  to  determine  if  elevation,  and  its 
associated  effects,  had  an  appreciable  influence  upon  the  accuracy  levels 
obtained. 
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RESULTS 


% 


Differences  among  the  vegetation  classification  systems  used  in  the 
three  methods  created  the  greatest  problem  in  comparing  Machine  Classified 
Landsat  (MCL),  Color  Composite  landsat  (CCL)  and  Medium  Scale  Color 
Infrared  (MSCIR)  aerial  photography  with  the  ground  truthing  data  gathered 

in  the  Piceance  Basin  during  September,  1983. 

I 
The  results  which  follow  shew  the  percent  accuracy  of  the  interpreted  if 

vegetation  community  types  (from  remotely  sensed  data)  compared  with  the 

i 

vegetation  types  recorded  during  ground  truthing.  Three  classification  3 

I 

comparisons  were  made  using  the  Combined  Classification  Svstem  (13  1 

I 
categories ) ,  the  Collapsed  Classification  System  ( 7  categories )  and  the 

General  Classification  System  ( 13  categories ) .  The  General  Classification 

I 
System  includes  as  a  match  any  vegetation  types  which  share  dominant  f 

species  in  both  the  remote  sensing  data  and  the  ground  truth  data.  In  an 

effort  to  determine  how  accuracy  was  influenced  by  the  examination  of  a 

larger  area,  a  comparison  of  the  accuracy  of  the  9  pixels  at  each  study 

I 

site  (pixel  level)  was  made  with  a  combined  characterization  of  all  nine  I 

I 
i 

pixels  into  one  type  (site  level).  In  addition,  aerial  cover  measurements  1 

I 
of  the  weedy  vegetation  were  recorded  at  each  site,  cost  estimates  were  1 

compared  for  MSCIR,  MCL  and  CCL,  and  a  final  comparison  examined  the 

n 

influence  of  elevation  on  accuracy  obtained  by  the  various  remote  sensing 
methods. 

Combined  Classification  System:  For  the  first  set  of  comparisons, 
each  of  the  original  classification  systems  was  condensed  into  13 

categories  (Table  2).  At  this  level  of  pixel  comparison,  the  accuracy  of 


22 


4f 


■% 


M& 


MCL  was  26%  ,  CCL  was  27%,  and  MSCIR  was  58%.  When  this  classification 
system  was  used  on  the  study  site  level,  MCL  accuracy  increased  to  29  j 
accuracy  increased  to  33%,  and  MSCIR  accuracy  increased  to  60%  (Appendices 
V  to  X). 

Collapsed  Classification  System:  In  the  Combined  Classification 
System,  some  categories  were  not  present  in  all  of  the  remote  sensing 
methods.  For  example,  the  MCL  classification  system  did  not  distinguish 
among  the  pinyon- juniper  associations.  Thus,  it  had  no  matches  for  the 
pinyon-juniper/sagebrush  or  pinyon- juniper/upland  shrub  categories  in  the 
other  classifications.  To  evaluate  this  negative  bias,  the  Combined 
Classification  was  collapsed  to  7  vegetation  types  as  discussed  earlier,  to 
provide  matches  for  all  categories  (Table  3).  At  the  pixel  level,  MCL 
accuracy  was  31%,  CCL  accuracy  was  42%,  and  MSCIR  accuracy  was  70%.  On 
the  study  site  level,  MCL  accuracy  increased  to  35%,  CCL  accuracy  incr^ 
to  44%  and  MSCIR  accuracy  increased  to  71%  (Appendices  XI  to  XVI). 

General  Classification  System:  A  third  comparison  was  made  using  the 
13  categories  from  the  Combined  Classification  and  matching  these 
categories  with  other  categories  within  that  system  that  contained  similar 
vegetation,  as  discussed  earlier  (Table  4).  Types  having  the  same  or 
nearly  the  same  dominant  taxa,  which  is  reflected  in  their  type  name,  were 
considered  to  be  matches,  e.g.,  aspen,  new  matches  with  aspen  and  with 
aspen/upland  shrub.  In  this  more  general  comparison  at  the  pixel  level, 
MCL  accuracy  was  48%,  CCL  accuracy  was  78%,  and  MSCIR  accuracy  was  78%.  On. 
the  study  site  level,  MCL  accuracy  increased  to  58,  CCL  accuracy  increased 
to  79%,  and  MSCIR  accuracy  increased  to  83%  (Appendices  XVII  to  XXII). 

Pixel/Site  Comparison:   Accuracy  evaluations  of  the  individual 
pixels  at  each  sampling  site  (pixel  level)  were  compared  to  a  combined 
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characterization  of  all  nine  pixels  into  one  type  (site  level).  Pixel 
comparisons  were  very  similar  to  site  catparisons  with  pixel  comparisons 
always  1%  to  10%  lower  in  accuracy  (Table  5).  The  relatively  minor  and 
consistent  differences  between  the  two  levels  of  conparison  indicate  that 
either  could  be  used  in  other  comparisons,  but  the  pixel  level  comparison 
is  recommended  because  it  provides  larger  sample  sizes  and  slightly  better 
resolution  at  little  or  no  additional  data  collection  cost.  The  pixel  and 
site  comparisons  indicate  that  registration  error  was  minor  compared  with 
classification  error. 

Remote  Sensing  Technique  Comparison:  The  MCL  accuracy  was  always  less 
than  the  CCL  accuracy,  which,  with  one  exception,  was  always  less  than  the 
iMSCIR  accuracy  (Table  5).  As  classification  system  ccnplexity  was  reduced 
(from  the  Combined  Classification  to  the  Collapsed  Classification  to  the 
General  Classification),  the  accuracy  of  each  remote  sensing  technique 
increased  (Table  5).  The  accuracy  of  CCL  increased  faster  (from  27%  to  78% 
at  the  pixel  level)  than  the  accuracy  of  MCL  (from  26%  to  48%)  or  the 
accuracy  of  MSCXR  (from  58%  to  78%). 

Vegetation  Cover:  Vegetation  cover  measurements  as  determined  from  a 
line  transect  at  each  study  site  provided  the  basis  for  more  accurate 
interpretations  of  the  diversity  and  composition  of  the  woody  vegetation. 
Cover  values  for  each  sample  are  presented  in  Appendix  XXIII.  Average 
values  for  each  quadrangle  are  found  in  Table  6,  where  the  quadrangles  are 
grouped  according  to  elevational  stratum  (either  below  or  above  7000  feet). 
The  cover  values  from  Appendix  XXIII  were  used,  along  with  visual 
estimation,  to  assign  each  pixel  a  ground  truth  cover  class.  A  comparison 
of  the  assigned  ground  truth  cover  classes  and  the  classification  derived 
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Table  5:  Sunraary  of  the  percent  accuracy  of  the  three  vegetation  irapping 
projects  (?CL,  CCL  and  MSCIR)  as  ccxnpared  to  ground  truth  in 
the  Piceance  Basin. 


BCL 

Landsat  Digital 


CCL 

Landsat  Manual 


MSCIR 
Color  Infrared 


Pixel  /Site 


Pixel  /  Site 


Pixel  /  Site 


Combined 
Classification 


26%     29% 


33% 


58% 


60% 


Collapsed 
Classification 


31% 


35% 


42% 


44% 


70? 


71% 


General 
Classification 


48% 


58% 


78% 


79! 


78% 


83% 


Pixel  level  of  rreasurement  =  50  x  50  ireters.  Site  level  of  measurement  =^BT  > 
150  meters  or  9  Pixels  centered  on  a  section  corner. 
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Table  6  Average  percent  cover  of  woody  vegetation  determined  from  52 
section  corner  sites.   (These  cover  values  represent  an 
average  cover  value  frcm  transect  in  which  the  species  occurs. 
Four  (4)  to  ten  (10)  transects  were  taken  in  each  quadrangle.) 


Quadrangle 

and 
Elevation 


AS 


Vegetation  Type 
BB   CC   JN   MM   OB   FN   RB   SB   SG   SN  OT 


Below  7,000' 
Square  S 
Segar  Mountain 
Calamity  Ridge 


36  15  21   46   3 

7   10   29   12   12   25   17   15   2 

9       12   10   47   18   19   2 


Above  7,000' 

No  Name 

Razor back  Ridge 
Circle  Dot       18 
Cut  Off  Gulch 


14 


15 

29 

14 

26 

2 

13 

16 

48 

31 

4 

11 

2 

28 

8 

27 

4 

24 

5 

22 

10 

33 

3 

AS  Aspen 

BB  Bitterbrush 

CC  Choke  Cherry 

JN  Juniper 


MM  Mountain  Mahogany 

OB  Oakbrush 

OT  Other 

PN  Pinyon 


RB  Rabbitbrush 

SB  Serviceberry 

SG  Sagebrush 

SN  Snowberry 
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from  MCL  and  MSCIB  are  found  in  Appendix  XXIV.  Rabbithrush  was  found  in 
heterogeneous  stands  in  all  of  the  quandrangles  sampled  but  does  not  hjfia^ 
large  cover  at  any  site.  Because  it  is  a  small  plant  {below  the  minimum 
resolution  size  of  MSCIR}  that  occurs  in  evenly  dispersed  stands  and  does 
not  have  a  distinctive  spectral  signature,  rabbi  thrush  was  generally  missed 
in  all  three  mapping  efforts. 

Cost  Comparisons  of  MSCIR,,  MCL  and  CCL:  A  comparison  of  the  costs  for 
mapping- vegetation  clearly  demonstrates  the  reduced  costs  associated  with 
landsat  imagery  (Table  7).  Although  land  managers  prefer  projects  to  be 
mapped  at  larger  scales  such  as  1:24,000,  the  cost  for  vegetation  mapping 
at  this  scale  was  approximately  132  times  greater  than  the  CCL  at  a  scale 
of  1:250,000  and  the  cost  of  MCL  was  approximately  66  times  greater  than 
the  cost  for  CCL. 

Elevation  Comparisons:  A  comparison  of  the  accuracy  levels  of  theg 
remote  sensing  methods  at  elevations  above  and  below  7,000  feet  was  rraJ 
determine  if  one  system  is  more  accurate  at  either  of  the  elevation  ranges 
(Table  8).  Data  were  compared  on  the  basis  of  the  elevation  assigned  to 
each  quadrangle.  In  those  quadrangles  with  midrange  elevation  below  7,000 
feet  (Square  S  Ranch,  Segar  Mountain  and  Calamity  Ridge),  using  the 
Collapsed  Classification  at  the  pixel  level  of  comparison,  MCL  accuracy  was 
valued  at  37%,  CCL  was  38%  and  MSCIR  was  68%.  In  those  quadrangles  with 
midrange  elevation  above  7,000  feet  (No  Name  Ridge,  Razorback  Ridge,  Circle 
Dot  Gulch  and  Cutoff  Gulch),  the  accuracy  of  MCL  was  estimated  at  24%,  CCL 
at  19%  and  MSCIR  at  69%.  Thus,  there  was  less  accuracy  in  MCL  (35%  less) 
and  CCL  (50%  less)  at  higher  elevations  (above  7,000  feet)  than  at  lower 
elevations.  Differences  in  elevation  made  no  perceptible  difference  in  the 
accuracy  of  MSCIR  data.  The  reduced  accuracy  at  higher  elevations  may 
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TABLE  7:  Comparison  of  specifications  and  costs  for  the  CCl,  MCL  AND  MSCIR 

Piceance  Basin  Mapping  Projects. 


CCL 


MCL 


MCIR 


Scale  of  input  data 

1:250,000 

N/A 

1:24,000 

Resolution 

79m 

79m 

"Y.„ 

jm 

Minimum  mapping  unit 

640  acres 

20-40  acres 

10  acres  (0.5  acres 

(160  acres 

for 

acres  for 

wetlands ) 

wetlands ) 

■1 


Classification  Level 
Anderson,  et.  al.  (1976) 


2  to  3 


3  to  4 


4  to  5 


* 


st  to  reformat  data 
o  digital  format  - 
( cents /acre } 


Cost  for  acquisition 
of  imagery  * 
( cents /acre ) 


0.06 

(to  category 
or  species/ 
assoc.  level) 

0.002 


4.1 

(to  species 

association 

level ) 

0.04 


6.7 

(species  or  % 
canopy  closure 
level ) 

1.5 


Total  cost  (cents/acre) 


0.062 


4.14 


8.2 


*  The  costs  are  based  upon  1983  rates  of  $9.60/square  mile  for  contract  aerial 
photography,  $300  for  a  Landsat  digital  data  tape,  and  $15  for  a  Landsat  false 
color  composite  at  1:250,000  scale. 
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attributed  to  species  diversity  and  density  .in  the  upland  shrub  vege| 
type.  J3CL  apparently  did  not  distinguish  aspen  fran  upland  shrub  at  J 
elevations  (Appendix  XXIV). 


29 


Table  8:   Summary  of  the  percent  accuracy  of  the  three  mapping  projects  (MCL, 
CCL,  and  MSGER)  when  the  sample  sites  are  separated  by  quadrangles 
with  midrange  elevations  below  and  above  7,000  feet  (Collapsed 
Classification,  pixel  level). 


Low  Elevation  Quadrangles 


High  Elevation  Quadrangles 


MCL 

Total 

Total 

#  Possible 

90   90   90 

270 

#  Possible 

45   63 

54 

36 

198 

#  Correct 

32   35   34 

101 

#  Correct 

7   11 

22 

8 

48 

%Accuracy 

37 

%Accuracy 

24 

CCL 

Total 

CCL 

Total 

#  Possible 

90   90 '   90 

270 

#  Possible 

45   63 

54 

36 

198 

#  Correct 

30   34   38 

102 

v   Correct 

7   11 

16 

3 

37 

\?b' 


%Accuracy 


38 


%Accuracy 


19 


MSCTP 

Total 

MSCIR 

Total 

#  Possible 

90 

90 

90 

270 

#  Possible 

45 

63 

54 

36 

198 

#  Correct 

63 

62 

58 

183 

#  Correct 

38 

37 

36 

25 

136 

%Accuracy 


68 


%Accuracy 


69 


Low  Elevation  Quadrangles:  Below  7000  Feet 

Square  S  Panch,  Segar  Mountain,  Calamity  Ridge 

High  Elevation  Quadrangles:  Above  7000  Feet 

No  Name  Podge,  JRazorback  Ridge,  Circle  Dot  Gulch,  Cutoff  Gulch 
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DISCUSSION 


The  results  of  this  assessment  suggest  that  the  vegetation  data  base 
derived  frcm  CCL  images  for  use  in  the  Consortium's  deer-elk  model  may  not 
be  sufficiently  accurate.  Carneggie,  et  al-  (1983)  report  that  overall 
accuracy  figures  of  less  than  70%  are  often  considered  unacceptable  for 
site  specific  mapping.  Although  values  of  78%  and  79%  were  obtained  with 
CCL  in  the  general  classification  (Table  5),  the  detail  of  this 
classification  system  may  not  be  sufficient  for  either  wildlife  management 
decisions  or  for  model  interpretations.  The  Piceance  Basin  Landsat  data 
(MCL  and  CCL)  are  less  accurate  at  elevations  above  7,000  feet  than  they 
are  for  elevations  below  7,000  feet.  Broad  leafed  species  at  elevations 
above  7,000  feet,  such  as  oakbrush,  serviceberry,  snowberry  and  aspen, 
appear  to  be  more  difficult  to  separate  using  Landsat  than  lowland  species 
such  as  sagebrush,  greasewccd  and  saltbush. 

The  choice  of  a  remote  sensing  data  source  in  a  mapping  project  is  a 
function  of  land  value  and  uses,  management  information  needs,  and  project 
budget  (Aldrich,  1981).   The  increased  cost  of  aerial  photography  for 
mapping  projects  can  more  easily  be  justified  when  and  where  the  greater 
need  for  management  intensifies  the  importance  of  higher  accuracy. 
Wildlife  habitat  assessment  may  be  done  at  a  site  specific  or  a  regional 
level.  Site  specific  studies  usually  include  a  small  area  in  which  the 
cost  of  an  aerial  photography  mapping  project  is  appropriate  (Carneggie  et  • 
al.  1983.)  Regional  assessments  are  more  cost  effective  when  decs  from  a 
combination  of  satellite  images  and  aerial  photographs.  The  combination  of 
Landsat  digital  data  and  Landsat  image  format  data  with  medium  scale  aerial 
photographs  allows  for  the  mapping  of  large  areas  in  an  efficient  and  cost- 
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effective  approach.  Hie  high  resolution  and  potentially  high  accuracy  of 
aerial  photography  in  combination  with  the  synoptic  and  sequential  coverage 
frcxn  Landsat  provides  sanagers  with- an  excellent  capability  to  analyze, 
assess,  and  monitor  habitat  over  broad  areas. 

Color  Composite  Landsat  (CCL)  is  the  nest  interpretable  of  the  Landsat 
data  and,  at  a  scale  of  1:250,000,  is  widely  accepted  as  a  map  base  fcr 
resource  information  (Carneggie,  et.  al.,  1983).  This  Landsat  form  (CCL) 
is  rapidly  replacing  photo-mosaics  for  general  management  planning  and  for 
displaying  and  orienting  geographic  information.  However,  as  stand-alone 
products,  CCL  maps  have  their  greatest  use  in  areas  where:  1)  other 
imagery  is  not  available,  2)  habitat  maps  are  not  available  and  3)  CCL 
is  used  for  stratification  of  effort  allocation  in  sampling. 

A  trade-off  for  the  poor  resolution  of  CCL  (MCJ  of  160  to  640  acres) 
is  the  low  cost  per  unit  area.  Linden,  et  al.  (1981)  reported  a  cost  of 
0.2  cents/acre  with  a  MMU  of  640  acres.   They  interpreted  evergreen 
woodland,  Mohave  desert  shrub,  Great  Basin  desert  shrub,  and  other 
vegetation  in  Arizona  from  CCL  and  achieved  83%  accuracy  from  a  standard 
false  color  composite  and  88%  accuracy  frcm  an  enhanced  image;  however, 
these  figures  were  not  statistically  different.  The  accuracy  of  CCL  maps 
carried  to  classification  Level  I  (Anderson,  et  al.,  1976)  was  70%  as 
cempared  with  77%  frcm  sm?U-scale  aerial  photography  (Fitzpatrick-Lins, 
1978 ) .  The  predominant  Level  II  land  uses  were  mapped  with  higher  accuracy 
than  those  occurring  less  frequently.  CCL  was  most  accurate  fpr  forest 
(band  5)  and  water  (band  7)  categories. 

The  variability  of  results  in  the  literature  make  the  assessment  of 
the  accuracy  and  usefulness  of  MCL  rangeland  cover  -raps  difficult 
(Carneggie,  et  al.,  1983).  Most  of  the  MCL  rangeland  mapping  studies 
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elevation  classes  (Miller  et  al.f  1981).  This  technique  was  incorporated 
into  the  unsupervised  MCL  classification  for  the  Piceance  Basin. 


An  economical  alternative  to  any  of  the  three  options  evaluated  here 
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1 
report  an  overall  accuracy  at  Level  I  ranging  from  75%  to  90%  (see  e.  g. , 

Krumpe  et  al.,  1973).  At  Level  III,  accuracy  figures  are  generally  less 

than  70%,  a  frequently  used  break-off  point  for  map  acceptability. 

Classification  accuracy  is  higher  in  mesic  environments  which  are  M 

m 

m 

characterized  by  having  relatively  few  cover  types  and  less  dense  m 

hi 
vegetation.  Cost  estimates  of  MCL  range  land  cover  mapping  was  reported  at  ff- 

1 
6  cents/acre  (Rchde  and  Miller,  1981)  and  2.8  cents/acre  (Linden,  et  al.,  1 

H 

1981).  1 

§ 

There  are  a  number  of  technical  difficulties  with  using  MCL  in  j| 

1 
rangeland  mapping  (Cameggie,  et  al.,  1983).  Training  statistics  f| 

I 
definition  (training  the  computer  to  look  for  the  best  match  of  spectral  £ 


signature  with  vegetation  types)  for  rangelands  is  particularly  difficult 
cue  to  the  spatial  heterogeneity  of  vegetation  and  soil.  Supervised 
classifications  are  time  consuming  and  leave  some  data  unclassified 

(Tueller,  1980  and  Hoffer,  1980).  Classification  accuracy  in  rangeland 

I 
mapping  was  improved  from  54  to  73  percent  by  class  sorting  based  on  |f 
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For  site-specific  mapping  of  rangeland  vegetation,  MSCIR  aerial  m 
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photography  is  the  choice  of  agencies  such  as  the  Bureau  of  Land  Management 

f 
and  the  Fish  and  Wildlife  Service.  Color  infrared  photography  is  preferred  $ 


because  of  better  contrast  between  vegetated  and  nonvegetated  areas,  M 

I 
differentiation  between  surface  water  and  wet  areas  without  surface  water , •  <£ 

m 

better  detection  of  stressed  vegetation,  and  better  ccntrast  between  m 


vegetation  types  (Aldrich,  1981).  m 
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may  be  use  of  medium  scale  (1:58,000)  color  infrared  photography  from,  the  38 
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National  High  Altitude  Photography  (NHAP)  program.  Thia  photography  may 
soon  be  available  for  the  entire  United  States,  but  was  not  available  for 
the  Piceance  Basin  Planning  Area  at  the  time  the  three  mapping  projects 
were  conducted.  The  1983  cost  for  stereo  NHAP  imagery  was  8  cents/acre. 
The  cost  to  reformat  the  data  into  digital  format  is  estimated  to  be  4.4 
cents/acre,  a  third  less  than  the  cost  for  1:24,000  scale  color  infrared 
aerial  photography.  Although  fewer  frames  of  photography  are  handled,  less 
detail  (lower  resolution)  is  available  to  the  photointerpreter.  The  NHAP 
imagery  can  be  interpreted  to  nearly  the  same  JMJ  as  1:24,000  scale 
photography  but  the  classification  accuracy  is  likely  to  be  somewhat  less. 
For  some  rangeland  applications,  NHAP  color  infrared  photo  enlargements  at 
a  nominal  scale  of  1:24,000  (12  cents/acre)  may  be  useful.  Medium  scale 
(1:65:000)  color  infrared  photography  is  used  by  the  U.  S.  Fish  and 
Wildlife  Service's  National  Wetland  Inventory  to  map  the  wetlands  of  the 
United  States  to  0.5  acre  MMU  using  the  Cowardin  et  al.  (1978)  wetland 
classification  system. 

In  summary,  there  is  little  justification  for  the  use  of  Landsat 
digital  (MCL)  data  analysis  at  the  present  stage  of  technology  in  rangeland 
mapping  applications  because  of  its  high  cost  and  low  accuracy  which  is 
little  better  than  that  obtained  frcm  manual  interpretation  of  color 
composite  Landsat  1:250,000  scale  images.  These  conclusions  do  not 
necessarily  hold  for  non-rangeland  mapping  (Sabins,  1978),  but  comparisons. 
similar  to  the  ones  reported  here  are  recctrmended  for  other  vegetation 
types.  Medium  Scale  Color  Infrared  (MSCIR)  imagery  continues  to  be  the 
choice  for  mapping  rangelands  because  its  accuracy  of  vegetation  mapping  is 
near  or  above  70%  and  is  requested  by  most  land  managers  if  funds  are 
available  (Carneggie,  et  al.,  1983).  Vegetation  typing  as  determined  by 
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MSCTR  and  available  in  the  MOSS  data  base  is,  therefore,  recormended  for 
use  as  the  data  base  for  the  Northwest  Colorado  Wildlife  Consortium  deer- 
elk  model. 

The  most  cost  effective  and  accurate  large  scale  mapping  effort  for 
rangeland  applications  may  be  a  stratified  selective  effort  using  a 
combination  of  MSCIR  aerial  photography  for  heterogeneous  and  high  interest 
areas  (such  as  ecotones,  riparian  zones,  and  wetlands)  and  small  scale 
aerial  or  satellite  imagery  for  homogeneous  and  low  interest  areas  where 
lower  accuracy  is  acceptable.  New  technologies,  such  as  the  Landsat 
thematic  mapper  and  airborne  video,  may  enhance  the  precision  of  satellite 
and  aerial  digital  data  in  the  near  future  to  the  point  of  improved  cost- 
efficiency  and  effectiveness  for  rangeland  vegetation  mapping  and 
construction  of  digital  data  bases. 


:t: 


P 


i 


fm 


1 


: 


V 


n 

k  Pi 


-m 


35 


^  Pcoi- 


LITERATURE  CITED 


Aldrich,  R.  C.     1981.     Limits  of  aerial  photography  for  multiresource  I 
inventories.     Proceedings,  Arid  Land  Resource  Inventories.  November  30  - 

December  6,   1980.     USDA  Forest  Service,     General  Technical  Report  WO-28,  B 

Washington  D.C.    620  p.  m 

1 

Anderson,  J.  A.,  Hardy,  E.  E.,  Roach,  J.  T.  and  R.  E.  Witner.  1976.  A  land  1 

use  and  land  cover  classification  system  for  use  with  remote  sensor  data.         S 

U.S.  Geological  Survey  Professional  Paper  964,  28  p.  j|| 

n 

Aronoff,  S.  1982.  The  map  accuracy  report:  A  user's  view,  Photcgr.  Eng.  11 

and  Remote  Sensing.  48:  1309-1312.  M 

81 

Carneggie,  D.M. ,  Schrumpf,  B.  J.  and  D.  A.  Mouat.  1983.   Rangeland  H 

Applications.  Manual  of  Remote  Sensing,  American  Society  of  fl 

Photcgrammetry,  Falls  Church,  VA,  Second  Edition,  Vol.  II.  2325-2384.  §j 

fm 
Cook,  C.  W.  1974.  Surface  rehabilitation  of  land  disturbances  resulting 
from  oil  shale  development.  Environmental  Summary.  Environmental 

Resource  Center,  Colorado  State  University,  Fort  Collins,  CO,  56  p  P 

|l 

wardin,  L.  M. ,  Carter,  V.,  Golet,  F,  C.  and  E.  T.  LaRoe.  1979.  £ 

Classification  of  wetlands  and  deepwater  habitats  of  the  United  States. 

U.  S.  Fish  and  Wildlife  Sercvice,  Office  of  Bioloqical  Services,  P 

FWS/OBS-79/31.   103  p.  If 


Dozrer,  J.  and  Alan  H.  Strahler.  1983.  Ground  investigations  in  support  of 
remote  sensing.  Manual  of  Remote  Sensing,  American  Society  of 
Photcgrammetry,  Falls  Church,  Va,  Second  Edition.  Vol.  I,  959-986. 

Estes,  John  E.,  Hajic,  E.  J.,  and  L,  R.  Tinney.   1983.  Fundamentals  of 

image  analysis:  analysis  of  visible  and  thermal  infrared  data.  Manual 
of  remote  sensing,  American  Society  of  Photcgrammetry,  Falls  Church,  VA, 
Second  Edition,  Vol.  I.  987-1124. 

Fitzpatrick-Lins,  K.  1978.  Accuracy  and  consistency  comparison  of  land 

use  and  land  cover  maps  made  from  high  altitude  photographs  snd  Landsat 
multispectral  imagery.  Journal  of  Research,  U.S.  Geol.  Survey,  Vol  6, 
No.  1,  23-40.  " 

t 

Hay,  A.M.  1979.  Sampling  designs  to  test  land-use  map  accuracy.  Photogramm 
Sngrg.  Remote  Sensing.  Vol.  45  (4):  529-533. 


&$, 


If 


It 

; 

M 


36 


Hoffer,  R.  M.  1980.  Computer-aided  analysis  of  remote  sensor  data  -  ma.<m   "  ) 

mystery,  cr  myth?  Prcceedings  ,  Remote  Sensing  for  Natural  Resources'^ 
Conference,  September  10-14,  1979-  College  of  Forestry,  Wildlife  and 
Range  Science,  University  of  Idaho,  Moscow.  156-179. 

Hord,  R.M.  and  W.  Brooner.  1976.  Land-use  map  accuracy  criteria.  Phctogramm 
Engrg.  Remote  Sensing  Vol.  42  (5):  671-677. 

Krumpe,  P.F.,  Nichols,  J.D.,  and  D.  T.  Lauer,  1973.  Analysis  of  wildland 
resources  using  manual  and  automated  techniques,  in  Sumposium  on 
Management  and  Utilization  of  Remote  Sensing  Data,  October  1973, 
Proceedings;  US  Geological  Survey,  EROS  Data  Centr,  Sioux  Falls,  South 
Dakota,  pp.  50-66. 

Lindauer,  I.  E.,  Olmsted,  C.  E.  Ill,  Kelley,  W.  A.  and  W.  A.  Grey.  1982. 
Terrestrial  ecosystems  of  northwest  Colorado:  an  annotated 
bibliography  and  vegetation  classification.  Volume  8  in  D.W.  Crumpacker, 
ed.  Wildlife  Consortium  and  energy  development  in  northwest  Colorado. 
Prepared  by  Northwest  Colorado  Wildlife  Consortium  and  published  by 
Ecological  Services  Section,  Colorado  Division  of  Wildlife,  Denver, 
Colo.  Vol.  14.  123  p. 

Linden,  D.  S.,  Rohde,  W.  G. ,  and  K.  G.  Bonner.  1980.  Estimating  the 

area  of  vegetation  types  with  Landsat  and  ancillary  data.  Proceedings, 
Arid  Land  Resource  Inventories.  November  30  -  December  6,  1980.  USD 
Forest  Service  Technical  Report  WO-26,  620  p. 

Mead,  R.  A.,  and  J.  Szajgin,  1982.  Landsat  classification  accuracy  assessment 
procedures:  Photcgrammetric  Engineering  and  Remote  Sensinq,  Vol  48(1) 
139-141. 

Miller,  W.  A.,  Bonner,  W.  J.,  Rohde,  W.  G. ,  and  L.  P.  Schwartz.  1981.  Digital 
Landsat  and  terrain  data  applied  to  an  arid  land  resource  inventory. 
Proceedings,  Arid  Land  Inventories:  Developing  Cost-Efficient  Methods, 
November  30-December  6,  1980.  La  Paz,  Mexico.  U.S.  Forest  Service  General 
Technical  Report  WO-28.  589-592. 

Rohde,  W.  G.,  and  W.  A.  Miller,  1981,  AVRI  (Arizona  Vegetation  Resources 
Inventory)  final  report:  Sioux  Falls,  South  Dakota,  U.S.  Geological 
Survey,  EROS  Data  Center,  EROS  Office  Internal  Report  to  BLM-Denver, 
200  p. 

Sabins,  Floyd  F.,  Jr.  1978.  Remote  sensing:  principles  and  interpretations. 
W.  H.  Freeman  &  Company,  San  Francisco,  CA.  426* p. 

Szajgin,  J.,  Pettinger,  L.  R. ,  Linden,  D.  S.  and  D.  0.  Ohlen.  1982. 
Arizona  vegetation  resource  inventory  (AVRI)  accuracy  assessment. 
Geological  Survey  Open  File  Report  82-814.  36  p. 


zvN&ri-vmsxwmmimfWiiKavmiiiwma 


37 


•■ 


eller,  P.  T.  1980.  Rangeland  remote  sensing  interpretation  problems. 

Proceedings,  Remote  Sensing  for  Natural.  Resources  Conference,  September, 
10-14,  1979,  College  of  Forestry,  Wildlife  and  Range  Science, 
University  of  Idaho,  Moscow.  450-465. 

United  States  Department  of  the  Interior,  Bureau  of  Land  Management,  1984. 
Piceance  Basin  resource  management  plan  and  environmental  impact 
statement.  White  River  Re.^ource  Area,  Colorado.  Meeker  CO,  270  p. 


i¥-ji: 


:■ 


I'-' 


I 


1 


*» 


'■'■■■£- 

si: 


38 


APPENDIX  I 


Piceance  Creek  Ground  Truth  Classification  and  Species  List 


AS  Aspen 

BB  Bitterbrush 

CC  Chokecherry 

DF  Douglas  Fir 

®  Grass 

G\  Greasewood 

JK  Juniper 

MD  Meadow 

MM  Mountain  Mahogany 

MS  Mountain  Shrub 

OB  Cakbrush 

FN  Pinyon  Pine 

PJ  Pinyon/Juniper 

RB  Pabbitbrush 

RD  Read 

S3  Serviceberry 

SG  Sagebrush 

SN  Sncwberry 

SO  Shale  Outcrop 

ST  Stream 

WE  Wetlands 


Populus  tremuloides 
Purshia  tridentata 
Prunus  Virginia 
Pseudostuga . menziesii 

Sarcobatus  vermiculatus 
Juniperus  spp. 

Cercocarpus  npntanus 

Quercus  gambelli 
Pinus  edulis 

Chrysotharrinus  spp. 

Anelanchier  alnifolia 
Artemesia  tridentata 
Symphoricarpus  spp. 
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APPENDIX  II 


!• 


Selected  Sample  Sites  and  Locations  For 

Piceance  Creek  Basin  Ground  Truth  Project 

September  1983 


m 
I 


Quad.  . 

Sample  Number 

Township  and  Ranqe 

Section 

Corner 

Square  S  Ranch 

7 

T1S,  R97W 

3 
10 

2 

11 

12 

T1S,  R97W 

8 
17 

9 

16 

• 

14 

T1S,  R97W 

10 

15 

11 
14 

16 

T1S,  RS8W 

14 
23 

13 
24 

17 

T1S,  R97/98W 

13 
24 

18 

19 

22 

T1S,  R98W 

22 

27 

23 
26 

25 

T1S,  R97W 

19 

20 
29 

30 

T1S,  R98W 

26 

35 

25 
36 

44 

T2S,  R98W 

2 

11 

1 
12 

47 

T2S,  R97W 

5 
8 

4 
q 

Sib  Name  Ridge 

1 

T2S,  R95/96W 

18 

24 

19 

8 

T2S,  R95W 

19 
30 

20 
29 

12 

T2S,  R95  W 

.   23 
26 

24 
25 

17 

T2S,  R95W 

27 

34 

26 

35 
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APPENDIX  II  Selected  Sample  Sites  and  Locations  for  Piceance  Creek  Basin 
Ground  Truth  Project  -  September  1983  Cent. 


If 

:  .-■  -_-■• 


No  Name  Pudge  Cent. 


Razorback  Ridge 


Seqar  Mountain 


20 

6. 
12 
22 
24 
29 
41 
48 

6 
10 
13 
25 
28 
31 
36 
37 


T2/3S,  R95W 

31  32 

no  PLS 

T3/4S,  R99W 

32  33 

5   4 

T4S,  R99W 

5   4 

8   9 

T4S,  R99/100W 

13  18 

24  19 

T4S,  R99W 

17  16 

20  21 

T4S,  R99W 

19  20 

30  29 

T4/5S,  RS9W 

no  PLS 

6   5 

T5S,  R99W 

5   4 

8   9 

T1S,  R95W 

2   1 

11  12 

T1S,  R95W 

16  10 

15 

T1S,  R95/96W 

13  18 

24  19 

T1S,  R95/96W 

25  30 

36  31 

ELS,  R95W 

27 

33  34 

T1/2S,  R95/96W 

36  31 

1   6 

T1/2S,  R95W 

36 

1   2 

T2S,  R95/96W 

1   6 

/ 

12 

It* 

m 


m 


..!■£.*  ■< 


■ 


r- 


41 

APPENDIX  II  Selected  Sample  Sites  and  Locations  for  Piceance  Creek  Basin 
Ground  Truth  Project  -  September  1983  Cant. 


m 


w 


Segar  Mountain  Cent.     39 

43 

Circle  Dot  Gulch        1 

10 
15 
20 
32 
'  39 


Cutoff  Gulch 


Calamity  Ridge 


it  - 


23 
30 
40 
42 

5 

6 

16 

17 


T2S,  R95W 
T2S,  R95/96W 

T5S,  R97W 
T5S,  R96W 
T5S,  R96W 
T5/6S,  R96/97W 

T6S,  R97W 
T6S,  R97W 

T4S,  R96W 
T4S,  R96W 
T/5S,  R96W 
T4  5S,  R96?V 

T2N,  R99W 
T2N,  R99W 
T1/2N,  R99/100W 
T1/2N7  R99W 


5 

4 

8 

9 

7 

13 

18 

14 

13 

23 

24 

20 

21 

29 

28 

30 

29 

31 

32 

36 

31 

4 

9 

10 

16 

15 

15 

14 

22 

23 

16 

15 

21 

22 

22 

23 

27 

26 

32 

33 

4 

34 

35 

2 

19 

20 

30 

29 

20 

21 

29 

28 

36 

31 

1 

6 

31 

32 

6 

5 
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APPENDIX  II  Selected  Sample  Sites  and  Loctions  for  Piceance  Creek  Basin 
Ground  Truth  Project  -  September  1983  Cont. 


Calamity  Fudge  Cont, 


22 
23 
30 
35 

40 

46 


TIN, 

R9 9/100 

1 

6 

12 

7 

TIN, 

R99W 

6 

5 

7 

8 

TIN, 

R99FW 

8 

9 

17 

16 

TIN, 

R99W 

18 

17 

19 

20 

TIN, 

R99/100W 

24 

19 

25 

30 

TIN, 

R99/100W 

25 

30 

36 

31 
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APPENDIX  III 


Machine  Classified  Landsat  Classification 
Piceance  Basin 


f 

2 


~& 


1-  Douglas  Fir  Woodland 

2.  Cottonwood  Bottomland 

3.  Willow/Tamarisk  Flocdplain 

4.  Aspen  Woodland 

5.  Aspen/Shrubland  Association 

6.  Serviceberry  Shrubland 

7.  Serviceberry  Oakbrush  Association 

8.  Mat  Saltbush  Shrubland 

9.  Mat  Saltbush/Shadscale  Association 

10.  Desert  Shrub-Swelling  Clays 

11.  Greasewocd  Shrubland 

12.  Greasewcod/Big  Sagebrush  Bottomland 

13.  Low  Elevation  Big  Sagebrush  Bottomland  (5300-7000  ft.) 

14.  Low  Elevation  Upland  Big  Sagebrush  (5300-7000  ft.) 

15.  Low  Elevation  Sagebrush  -  Exposed  Slopes  (6000-7000ft. ) 

16.  High  Elevation  Upland  Big  Sagebrush  (above  7000  ft.) 

17.  Black  Sagebrush/Grassy  Fudges  (above  7000  ft.) 

18.  Low  Elevation  Pinyon-Juniper  -  Shallow  Soils  (5300-6000ft. ) 

19.  Low  Elevation  Pinyon-Juniper  -  North  Facing  Slops  (5300-6000ft. ) 

20.  Moderate  Elevation  Pinyon  Juniper  -  Moderately  Deep  Soils  -  North 
Facing  Slopes  (6000-7000ft. ) 

21.  Moderate  Elevation  Pinyon-Juniper  -  Exposed  Shallow  Soils 

22.  Pinyon-Juniper  Rockland  Complex 

23.  High  Elevation  Pinyon/Rockland  (above  7000  ft.) 

24.  High  Elevation  Pinyon  (above  7000  ft.) 

25.  Wet  Meadow 

26.  Hillside  Bunchgrass/Forb  Community  (6000-7000  ft.) 

27.  Agriculture  -  Irrigated 

28.  Agriculture  -  Subirrigated 

29 .  Industrial/Disturbance 

30.  Low  Elevation  Barren  Slopes  (5300-6000  ft.) 

31.  Cathedral  Bluff  Shale  Outcrop  -  Steep  Slopes 

32.  Water 
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APPENDIX  IV 


Color  Composite  Landsat  Classification  and 
Medium  Scale  Color  Infrared  Photography  Classification 

Piceance  Basin 


AN 

Annual  Grass 

AS 

Aspen 

BN 

Bunch  Grass 

BR 

Bare  Rock 

BS 

Bare  Soil 

CN 

Coniferous 

DF 

Douglas  Fir 

DS 

Desert  Grass 

GR 

Greasevocd 

HA 

Ealophytic  Shrub 

HR 

Herbaceous 

JN 

Juniper 

LP 

Lodgepoie  Pine 

OB 

Cakbrush 

or 

Other 

PD 

Ponderosa  Pine 

PJ 

Pinyon/Juniper  Assn 

py 

Pinyon  Pine 

SA 

Subalpine  Fir 

SF 

Spruce/Fir  Assn. 

SG 

Sagebrush 

SH 

Short grass 

SL 

Saltbush 

SP 

Spruce  Species 

UD 

Upland  Deciduous 

US 

Upland  Shrub 

''LV& 


m 
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APPENDIX  V 


A  Comparison  of  Machine  Classified  Laodsat  (2CL)  with  Ground  Truth 
Using  a  Combined  Classification  at  the  Pixel  Level 


I 


I 


";5 

I 
1 


Classified  Vegetation  Type 
4   5   6   7   8   9  10  11  12  13 


1 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

3 

0 

0 

4 

0 

G 

2 

4 

4. 

0 

0 

0 

0 

0 

0 

0 

0 

13 

0 

0 

21 

19 

r 

3 

2 

0 

0 

0 

0 

3 

0 

0 

0 

0 

2 

0 

0 

7 

0 

o 

4 

1 

0 

0 

0 

0 

9 

0 

0 

5 

0 

6 

G 

0 

21 

0 

u 

5 

0 

0 

0 

4 

0 

4 

0 

0 

12 

G 

0 

0 

0 

20 

0 

n 

6 

1 

0 

3 

5 

0 

30 

0 

0 

21 

0 

3 

0 

0 

63 

48 

d 

7 

0 

0 

0 

0 

0 

14 

0 

0 

7 

0 

1 

0 

0 

22 

0 

8 

0 

0 

0 

0 

0 

8 

0 

_0 

7 

0 

2 

0 

0 

17 

0 

T 

9 

1 

4 

0 

1 

0 

17 

0 

0 

9 

2 

8 

0 

0 

42 

21 

r 

10 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

U 

11 

29 

43 

2 

0 

0 

63 

0 

0 

32 

0 

77 

3 

0 

249 

31 

t 

12 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

h 

13 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0_ 

1 

0 

TOTAL      38  51   5  12   0  149   0   0  93  2  115   3   0   468 

%Corr      08000  20   00  10  0  67   00 
Total  Accuracy:  26% 

Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  VI 


A  Comparison  of  Color  Composite  Landsat  (CCL)  with  Ground  Truth 
Using  a  Combined  Classification  .at  the  Pixel  Level. 


Classified  Vegetation  Type 


9  10  11  12  13  TOTAL  Correct 


G 

1 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

3 

0 

0 

4 

0 

r 

2 

1 

11 

0 

0 

0 

0 

0 

0 

0 

0 

9 

0 

0 

21 

52 

o 

3 

0 

0 

0 

0 

0 

0 

0 

7 

0 

0 

0 

c 

0 

7 

0 

u 

4 

0 

0 

0 

2 

0 

0 

0 

9 

0 

0 

10 

0 

0 

21 

1 

n 

5 

0 

0 

0 

7 

0 

2 

11 

0 

0 

0 

0 

c 

0 

20 

0 

d 

6 

0 

0 

0 

0 

0 

0 

28 

35 

0 

0 

0 

o 

0 

63 

0 

7 

0 

0 

0 

0 

0 

0 

21 

1 

0 

0 

0 

0 

0 

22 

95 

T 

8 

0 

0 

0 

9 

0 

0 

4 

A 

0 

0 

0 

0 

0 

17 

24 

x 

9 

8 

0 

0 

0 

0 

5 

8 

16 

0 

0 

5 

0 

0 

42 

0 

u 

10 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

1 

0 

11 

0 

15 

0 

0 

0 

9 

0 

135 

0 

0 

90 

0 

0 

249 

36 

h 

12 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

13 
AL 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

1 

0 

TO! 

9 

27 

0 

18 

0. 

18 

72 

207 

0 

0 

117 

0 

0 

468 

%Corr 

0 

41 

0 

11 

c 

0 

29 

2 

0 

0 

77 

0 

0 

wm 


■:  -. 

Ms, 


■■■ 
ml 
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m 
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Total  Accuracy:     27% 


Underlined  values  indicate  correct! v  classified  cells, 
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APPENDIX  VII 


A  Ccmpariscn  of  Medium  Scale  Color  Infrared  (MSCER)  Photography  Data 
with  Ground  Truth  Using  a  Combined  Classification  at  the 

-  Pixel  Level. 


& 


Classified  Vegetation  Type 


fl 


"i 


9  10  11  12  13 


TOTAL 


1 

4 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

4 

100 

G 

2 

19 

0_ 

0 

1 

0 

0 

0 

0 

1 

0 

0 

0 

0 

21 

0 

r 

3 

0 

0 

6 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

7 

86 

o 

4 

1 

0 

1 

11 

7 

0 

0 

0 

0 

0 

1 

0 

0 

21 

52 

u 

5 

0 

0 

0 

2 

7 

0 

3 

0 

8 

0 

0 

c 

0 

20 

35 

n 

6 

0 

0 

0 

0 

1 

25 

18 

8 

2 

0 

9 

0 

0 

63 

40 

d 

7 

0 

0 

0 

0 

0 

1 

9 

0 

11 

0 

1 

0 

0 
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Total  Accuracy:  58% 

Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  VIII 


A  Conparison  of  Machine  Classified  Landsat  (MCL)  with  Ground  Truth 
Using  a  Combined  Classification  at  the  Site  Level 
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Total  Accuracy:     29% 

Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  IX 


A  Ccsrparsicn  of  Color  Ccnposite  Landsat  (CCL)  with  Ground  Truth 
Ds±ng  a  Conbined  Classification  at  the  Site  Level. 
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TOTAL      0202   02  13  16   00  17   0   0 
%Corr      -50   -   0   0   0  23   6   -   -71 
Total  Accuracy:   33% 

Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  X 


A  Carparison  of  Medium  Scale  Color  Infrared  (MSCIR)  Photography  Data 
With  Ground  Truth  Using  a  Combined  Classification  at  the  Site  Level. 


Classified  Vegetation  Type 


% 


9  10  11  12  13  TOTAL  Correct 


TOTAL      33113443  10   0  20   0 
%Corr      0  67  100  100  33  75  25   0  30   -  95 
Total  Accuracy:  60% 

Underlined  values  indicated  correctly  classified  cells. 
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APPENDIX  XI 

I 

A  Conparison 

of  Machine  Classified  Landsat 

(MCL) 

with  Ground 

If 

Truth  Using 

a  Collapsed  Classification  at 

the 

Pixel  Level. 
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Classified  Vegetation  Type 
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TOTAL  89  12  0  149  93  115  10 
%Corr  9.0  35  10  67  0 
Total  Accuracy:  31% 


468 


fi 


Underlined  values  indicate  correctly  classified  cells. 


H 

I 

•Hi 


'.  g  ■.-*--■=  y  ■-■■«"  -v.B]  i^'.hj*  1 1  fa  ■■"■ 


cr^vrrTr^^-.T^^^Kr^j^...  i-r^r-gayy 


52 


APPENDIX  XII 


A  Comparison  of  Color  Composite  Iandsat  (CCL)  With  Ground 
Truth  Using  a  Collapsed  Classification  at  the  Pixel  Level. 


Classified  Vegetation  Type 
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Total  Accuracy:     42% 


Underlined  values  indicate  correctly  classified  cells. 
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APPHOIX  XIII 


A  Comparison  of  the  Medium  Scale  Color  Infrared  (MSCIR)  Photography 
Data  With  Ground  Truth  Using  a  Collapsed  Classification  at  the 

Pixel  Level 
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Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  XIV 

A  Comparison  of  Machine  Classified  Landsat  (KCL)  With  Ground 
Truth  Using  a  Collapsed  Classification  at  the  Site  Level. 
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Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  XV 


A  Comparison  of  Color  Composite  Landsat  (CCL)  With  Ground 
Truth  Using  a  Collapsed  Classification  at  the  Site  Level. 


Classified  Vegetation  Type 
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Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  XVI 


A  Comparison  of  Medium  Scale  Color  Infrared  (MSCIR)  Photography 
Data  With  Ground  Truth  Using  a  Collapsed  Classification  at 

the  Site  Level. 
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Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  XVII 


A  Ganparison  of  Machine  Classified  Laridsat  (MCL)  with  Ground  Truth 
Using  a  General  Classification  at  the  Pixel  Level. 
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Underlined  values  indicate  correctly  classified  cells, 
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APPENDIX  XVIII 


A  Cccparison  of  Color  Ccnposite  Landsat  (CCL)  with  Ground  Truth 
Using  a  General  Classification  at  the  Pixel  Level. 
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Total  Accuracy:  781 


Dnder lined  values  indicate  correctly  classified  cells- 
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APEEEDIX  XIX 


A  Ccmparison  of  tedium. Scale  Color  Infrared  (HSCXR)  Photography  Data 
With  Ground  Truth  Dsing  a  General  Classification  at  the  Pixel  Level. 


Classified  Vegetation  Type 


8   9  10  11  12  13   TOTAL  Correct 


1  4_000000600000  4  100 

2  190010000100.00  21  90 

3  0060001000000  7  86 

4  10111700000100  21  52 

5  0002703080000  20  75 

6  000012518820900  63  81 
1  0000019_0110100  22  95 

8  00000£13_000400  17  100 

9  50022400260300  42  67 

10  0000000001000  1  100 

11  8        6_       0       1       5       1       7        6     34        0  181       0        0  249  78 

12  00000000000_00  0 

13  0001000000000  0 


TOTAL      37   6   7  18  22  31  51  14  82   1  199   0   0   468 
%Corr      62  100  86  61  41  81  78  100  55  100  93 
Total  Accuracy:  78% 

Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  XX 


A  Comparison  of  Machine  Classified  Landsat  (MZL)  Data  With  Ground 
Truth  Using  a  General  Classification  at  the  Site  Level. 


Classified  Vegetation  Type 
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TOTAL      1  11   0   1   0  13   4   0  10   0  12   0   0    52 
%Corr      0  100   -   0   -  46   0   -  30   0  83   0   0 
Total  Accuracy:  58% 

Underlined  values  indicate  correctly  classified  cells. 
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APPENDIX  XXI 


A  Ccmparisan  of  Color  Composite  Landsat  (CCL)  With  Ground  Truth 
Using  a  General  Classification  at  the  Site  Level. 


Classified  Vegetation  Type 
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TOTAL  0  2  0  2  0  2  13  16  0  0  17 
%Corr  -  100  -  0  0  0  69  94  -  -  88 
Total  Accuracy:  79% 

Underlined  values  indicate  correctly  classified7  cells. 
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APPENDIX  XXII 


A  Comparison  of  Medium  Scale  Color  Infrared  (MSCIR)  Photography  Data 
With  Ground  Truth  Using  a  General  Classification  at  the  Site  Level 


Classified  Vegetation  Type 


% 


9  10  11  12  13   TOTAL  Correct 


TOTAL  33113443  10  0  20  00 
%Corr  67  100  100  100  33  100  75  100  70  -  95  -  - 
Total  Accuracy:  83% 

Dnder lined  values  indicate  correctly  classified  cells.     / 
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Percent  Aerial  Cover  from  Ground  Truth  Vegetation  Measurements 

Piceance  Basin 
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APPENDIX  XXIV 


I' 
I 

■:t. 
f 


Conparison  of  Landsat  MCL  and  MSCER  (1:24,000) 

With  Ground  Truthing  (GT) 

In  Pixels  2,  5,  &  8 

(Conbined  Classification  -  13  Classes) 
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APPENDIX  XXIV  Comparison  of  Landsat  MCL  and  MSCIR  (1:24,000)  with 

Ground  Iruthing  (GT)  In  Pixels  2,  5,  &  8  Cant. 
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APPENDIX  XXIV  Cajparison  of  Landsat  MCL  and  MSdR  (1:24/000)  with 

Ground  Truthing  (GT)  In  Pixels  2,  5,  &  8  Cant. 
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